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We search for evidence of resonant top quark pair production in 955 pb~^ of pp collisions at 
y/s = 1.96 TeV recorded with the CDF II detector at the Fermilab Tevatron. For fully reconstructed 
candidate tt events triggered on leptons with large transverse momentum and containing at least 
one identified 6-quark jet, we compare the invariant mass spectrum of ti pairs to the expected 
superposition of standard model tt, non-ti backgrounds, and a simple resonance model based on a 
sequential Z' boson. We establish upper limits for fj{pp —> Z') ■ Br{Z' —> tt) in the Z' mass interval 
from 450 GeV/c^ to 900 GeV/c^ A topcolor leptophobic Z' is ruled out below 720 GeV/c^, and 
the cross section of any narrow Z'-like state decaying to ti is found to be less than 0.64 pb at 95% 
C.L. for Mz' above 700 GeV/c^ 
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Resonant top pair production in hadronic collisions has 
been discussed in the context of extended gauge theories 
with massive Z-like bosons G|, 0; 13] ' theories with top- 
color 3 , or with axigluons Q . Decays to tt are of special 
interest in leptophobic models that would evade detec- 
tion in traditional searches based on dielectron or dimuon 
signatures. More recently, resonant top pairs have been 
suggested as signatures for Kaluza-Klein (KK) states of 
gluons, weak bosons, and gravitons [1,0, 11]; in some of 
these models the KK excitation couples strongly to the 
top quark and tt is the dominant decay mode. 

A tt resonance would appear as unexpected structure 
in the spectrum of the invariant mass of ti pairs Mu- 
Previous searches using « 100 pb~^ samples from Fer- 
milab Tevatron Run I have ruled out the production of 
a narrow leptophobic topcolor resonance with mass less 
than 480 GeV/c^ [§,[i3|- Here, we search for resonant 
structure in the Mtt spectrum in 955 pb""'^ of pp colli- 
sions at = 1.96 TeV recorded with the CDF II de- 
tector in Tevatron Run II. Modeling the resonance as a 
narrow massive vector boson Z' , and calculating its mass 
with techniques used in precision measurement of the top 
quark mass [ll|, we set limits on the cross section times 
branching ratio aB = a{pp Z')-Br{Z' tt) as a func- 
tion of Mz' ■ This study is complementary to Ref . [l^] , 
which uses a different event selection and reconstruction 
of the tt kinematics. 

The CDF II detector comprises a spectrometer in a 
1.4 T magnetic field surrounded by projective electro- 
magnetic and hadronic calorimeters and muon detectors 
[13]. The spectrometer, consisting of silicon microstrip 
detectors surrounded by a large open cell drift chamber, 
provides precision track reconstruction and displaced sec- 
ondary vertex detection. We use coordinates where (j) is 
the azimuthal angle, 9 is the polar angle with respect to 
the proton beam axis, transverse energy is Et — E sin(6') , 
and the pseudorapidity is rj = — ln[tan(0/2)]. The data 
used here were recorded between March 2002 and Jan- 
uary 2006. 

We collect a sample of tt W~^bW~b candidate events 
with one leptonic W boson decay using triggers that re- 
quire a central {\r]\ < 1.0) electron with Et >18 GeV or 
central muon with transverse momentum px >18 GeV/c. 
After offline reconstruction, we select events with an 
isolated electron with Et > 20 GeV or muon with 
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Pt > 20 GeV/c, missing transverse energy > 20 GeV 
consistent with a neutrino from W decay, and at least 
four hadronic jets with ]?/] < 2.0, of which three must 
have Et > 15 GeV, and a fourth must have Et > 8 GeV 
[H]. The jets are clustered in fixed cones of radius 
AR = ^/(Ary)2 -|- (A(/))2 < 0.4. At least one of the jets is 
required to be 6-tagged, i.e. contain a reconstructed sec- 
ondary vertex displaced from the primary event vertex 
as expected from the decay of a bottom hadron in the jet 
[m . We find 347 events fulfilling these criteria. 

The sample is dominated by s-channel qq annihila- 
tion into tt pairs [l3, [13] ■ The tt acceptance and ef- 
ficiencies are calculated using the herwig generator [13] 
and a detector simulation, assuming a top mass Mt = 
175 GeV/c^. The simulated detector response, particu- 
larly with respect to lepton isolation, jet energies, and 
6-tagging, has been tuned in an earlier measurement of 
the top pair production cross section ^l3] . The total com- 
bined trigger and reconstruction efficiency is 3.5 ± 0.5%. 
Non-tf backgrounds include W bosons produced in as- 
sociation with jets (H^-l-jets), where a light flavor jet 
is incorrectly 6-tagged; M^-|-jets events with real heavy- 
flavor jets; mismeasured QCD multi-jet events with one 
jet identified as a lepton; and smaller contributions from 
electroweak processes such as diboson {WW, WZ, ZZ) 
and single-top production. The rates and kinematics 
of these processes are modeled with simulated and data 
control samples as employed in the top cross section mea- 
surement [iJ]. A total of 73 ±9 non-<t background events 
are expected. 

The final state of four jets, a high-p^ lepton, and t,T 
allows an over-constrained reconstruction of the top pair 
kinematics. The assignment of jets to quarks most con- 
sistent with the tt hypothesis is determined using the 
minimization algorithm employed in the measurement of 
the top mass [nj. Here, following [iJ], we include the 
known top mass as a constraint, which improves the ac- 
curacy of the parton assignments. The measured jet ener- 
gies are corrected back to parton values using calibrations 
derived from photon-jet balancing and detector simula- 
tion |i20| . In the minimization the parton energies 
are varied within their uncertainties and the W and top 
masses are constrained to the values My^ — 80.4 GcV/c^ 
and Mt = 175.0 GeV/c^ within their natural widths (2.1 
and 1.5 GeV/c^ respectively). The eff'ect of variation in 
the central value of Mt is included later as a systematic 
uncertainty. Jets with 6-tags must be associated with h 
quarks. The jet-quark assignment giving the lowest 
consistent with these constraints is chosen as the solu- 
tion. In simulated tt events we find a small number of 
poorly reconstructed events fiagged by extreme x^- We 
find the sensitivity of the search is optimized by requir- 
ing x^ < 50; this cut removes 4% of tt events and 9% of 
non-tt backgrounds. 

We model the resonant tt production mechanism as 
a sequential Z' , a heavy neutral boson with the same 
couplings as the Z, here including decay to ti with 
Mt = 175 GeV/c^. This electroweak channel has no in- 
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terference with the strong production processes and the 
model hneshape is purely Lorentzian. To facilitate com- 
parison to other results [1, [13, [13 we assign the same 
narrow width used there, Tz' = O.Q12Mz'- A strictly 
sequential Z' with open tt decays has Tz' — O.OSAfz'- 
Since our reconstructed mass resolution is greater than 
60 GeV/c^ (see below) the analysis is insensitive to model 
dependent width differences at this level, and applies to 
any narrow ti state appearing as a single enhancement 
in the M^f spectrum. Signal models are generated using 
the PYTHIA simulation [2l| with Z' masses between 450 
and 900 GeV/c^ in increments of 50 GeV/c^. 
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FIG. 1: Simulated Mtt spectrum for 955 pb~^ in presence of 
a 750 GeY/c^ Z' with aB = 1 pb (shaded curve). The points 
are a simulated data set. The solid line is the best fit to a 
superposition of the Z' signal (solid histogram) and the ex- 
pected ti (dot) and non-ti (dot-dash) backgrounds. The inset 
shows a magnified view of the reconstructed Mjj spectrum 
for a 750 GeV/c^ Z' . The low mass tail arises from incorrect 
jet-parton associations. 



The inset of Fig. [T] shows the Mjf distribution recon- 
structed for a simulated 750 GeV/c^ Z' . There is a peak 
near the expected value and a low mass tail which arises 
from the incorrect jet-parton assignments where a jet 
from initial or final state radiation has been used instead 
of a jet from top decay. The rms of the peak region is ap- 
proximately 60 GeV/c^ and the full rms is 137 GeV/c^. 
Other Z' masses show similar behavior: the Mz' peak 
width is preserved and the low mass tail extends down 
to the kinematic threshold at 350 GeV/c^. The full rms 
of the Mtt distribution varies between 67 and 178 GeV/c^ 
over our Z' mass range. The fraction of Z' removed by 
the cut varies between 4% and 9% over the Z' mass 
range. 



We use a three-parameter binned likelihood maximiza- 
tion to fit the Mtt spectrum to a superposition of the 
expected shapes for Z' tt, standard model tt, and 
non-it processes. In the z*'' bin, we expect 



Mi = 



aBAe / Cdt 



Pz'.. + NtiPtu + Nbk.Py 



bUg^blcg-z 



(1) 



where Pz',i, Ptt.ii ^^'^ Phkg,i sue the probabilities of ob- 
serving a signal event, tt event or non-tt background 
event in bin i, respectively. Ntt and A'^bkg are the number 
of non-resonant tt and the non-tt background events. The 
aBAe J Cdt term contains the product of cross-section 
and tt branching ratio, acceptance, and efficiency for the 
Z' , and the luminosity. 

A likelihood function L for the distribution can be writ- 
ten as 



L = ]^T'j(ni|//i)G(;/fe|j/fe,o-^J. 



(2) 



i.k 



The function Vi{ni\fii) is the Poisson probability for ob- 
serving rii events in a bin i where /ii are expected. The 
functions G(j'fe|S'fc, ti^^) constrain the nuisance parame- 
ters Vk, which include the non-tt background normaliza- 
tion A^bkg, b-tSLg efficiency, acceptances and luminosities, 
with Gaussian probability around their central values Dk 
and uncertainties ai,^, . The tt and non-tt background val- 
ues are taken from |l4| , and the Z' acceptances and effi- 
ciencies are determined from the PYTHIA simulation. We 
find aB, Ntt, A^bkg, and Vk that maximize the likelihood 
function for each Mz>- 

The algorithm is tested with simulated samples where 
the tt, non-tt, and Z' models are combined in the ex- 
pected ratios and sampled with the expected level of sta- 
tistical fiuctuations. The points in the main part of Fig. [T] 
show the Mtt distribution for a simulated data sample 
corresponding to an integrated luminosity of 955 pb~^ 
in the case of a 750 GeV/c^ Z' with aB = 1 pb. The 
histograms show the components as resolved by the likeli- 
hood fit. The extraction of the Z' component uses shape 
information from the low mass part of the specturm as 
well as the peak area. 

The 95% C.L. upper limit on aB at a given mass 
is found by integrating the likelihood along aB, re- 
optimizing at each point, to find the value that contains 
95% of the area. We measure our expected sensitivity 
using large ensembles of simulated samples like the one 
shown in Fig. [TJ The main sources of systematic un- 
certainty are the acceptance change due to energy scale 
uncertainty on the jet thresholds, and the shape change 
in Mtt from the top mass uncertainty. Model dependent 
shape effects associated with initial and final state gluon 
radiation and non-tt backgrounds are small. Simulated 
samples with reasonable variations for systematic effects 
are used to measure the apparent shifts in the fitted aB 
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as a function of the true value. The sum of the shifts 
in quadrature is used as the width of a Gaussian reso- 
lution function that is convolved with the likelihood as 
a function of aB. The systematic uncertainties worsen 
the limits by roughly 0.2 pb, independent of the Z' mass, 
with the increase dominated by the effects of jet energy 
scale and the top mass uncertainty in equal measure. The 
expected 95% C.L. upper limits including all sources of 
uncertainty are shown as a function of Mz' in the middle 
column of Table [T] If no Z' is present our expected cross 
section limit at high AIz' is 0.55 pb. 




FIG. 2; The invariant mass of top quark pairs Mtt observed 
in the data is compared to the no Z' expectation. The non-tt 
backgrounds are constrained to the expected value and the 
sum of tt and non-tt equal the number of data events. 



above the expected value of approximately one standard 
deviation. 

TABLE I: Expected and observed limits (95% C.L.) on 
a{pp Z') ■ Br{Z' tt) as a function of Mz' for 955 pb"\ 
including both statistical and systematic uncertainties. 

Mz'{GeY/c^) Expected Limit (pb) Observed Limit (pb) 
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9 97+0.79 
^•^'-0.57 
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1 Q9+0.63 


2.72 
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1.57 
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0.61 


800 


U.08_Q 07 


0.60 
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0.57 
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0.57 
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FIG. 3: Upper limits (95% C.L.) on the production cross 
section for ti resonance along with expected cross sections for 
several models. 



The Mf-t distribution measured in the data is shown in 
Fig. [2] A final sample of 327 candidates remains after 
the requirement. In this figure we compare the ob- 
servation to the expected spectrum in the case of no Z' . 
The non-U component is fixed at the expected value and 
the ti normalization is scaled to match the total num- 
ber of events. The inferred top production cross sec- 
tion is a{tt) — 7.8 ± 0.7 pb (statistical error only), to 
be compared with the predicted standard model value of 
6.7 pb for Mt = 175 GeV/c^ [Mill- The inset shows 
the measurement on a logarithmic scale. The simulated 
M(j spectra for tt and non-tt describe the data well. 

Applying the full limit procedure to the spectrum in 
Fig. [2] we find 95% C.L. upper limits on a{pp — > Z') ■ 
Br{Z' tt) as listed in the rightmost column of Table[Tl 
The limits at high mass are consistent with expectation. 
At lower masses our measurement shows an excursion 



The result is represented graphically and compared to 
some theoretical predictions in Fig.[3l The observed limit 
is the solid black line and the shaded band around the 
grey line denotes the ±1(t uncertainties around the ex- 
pected upper limit. A leptophobic Z' predicted by the 
topcolor theory [1], shown as a large-dotted line, is ruled 
out below 720 GeV/c^ at 95% C.L. The small-dotted 
curve at the bottom of the figure is the expected cross 
section for a sequential Z', calculated with the herwig 
simulation using a multiplicative factor of 1.3 to account 
for NLO effects. A leptophobic Z' with these couplings 
would evade direct searches in dilepton final states, and 
because the ti detection efficiency is small, is still out of 
range of our sensitivity in the ti mode. The Tevatron 
cross section for the KK gluon excitation in the Randall- 
Sundrum model of Ref. Q is shown as a dot-dash line 
[2^ . Since the KK resonance is broad (F « 0.17M), our 
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limits derived in the "narrow width" assumption are not 
strictly applicable; we show the curve here for qualitative 
comparison. The cross section of any narrow Z'-like state 
produced in pp collisions at -^i = 1.96 TeV and subse- 
quently decaying to ti is less than or equal to 0.64 pb 
(95% C.L) for all Mz' above 600 GeV/c^. 
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